Multi-video receiving method and apparatus

ABSTRACT

A method and apparatus is disclosed for receiving a plurality of video signals using a single video signal transmitted using a point-to-multipoint connection; the plurality of video signals originate from various locations of an event. Information received using a reception unit comprises at least one of the plurality of video signals, at least one of the plurality of sound track signals related to the at least one of the plurality of video signals, data transmitted using the vertical blanking interval (VBI) of the single video signal and graphics.

FIELD OF THE INVENTION

This invention relates to multi-video program receiving method and apparatus, and more precisely, to the displaying and access to more than one video program related to a live event.

BACKGROUND OF THE INVENTION

Assisting to a live event is usually an enjoyable experience as all our senses are overwhelmed by various sensations. The assisting is therefore more enjoyable than a remote assisting via a television program related to said event. Unfortunately, it is usually difficult to have more than one view of the event when assisting to said event. This is particularly true during Formula 1 Grand Prix competitions, where a viewer is usually seated at a particular point of the circuit. Usually in that case, the viewer cannot have access to other parts of the circuit unless a large screen is available for instance. This may avoid the viewer to enjoy an action that is taking place at another location of the circuit unavailable to him.

Various solutions have been implemented in order to enable the viewer at the live event to access more information about the event.

For instance, in some major car racing events, such as CART/NASCAR, radio scanners are available. Such radio scanners enable the live event viewer to scan and listen to conversations between a pilot and his crew. Unfortunately the device lacks excitement and entertainment because it only offers sound, making it difficult for the user to easily understand who they are listening to and being potentially more disruptive than enhancing.

Mini portable television sets have been developed and are already available on the market. Via such mini portable television sets, the live event user can watch the race to the extent that it is broadcast, but, in most cases, the live events are broadcast on cable TV and are therefore inaccessible to these devices. These mini portable television sets have therefore limited applications and do not offer the excitement or any added value of the event that would motivate the users to widely use it.

Wireless handled devices based on web technology have also been developed. These devices run on PDA and are linked to the web. Such devices provide VIP guests and general audience live timing and scoring, radio feeds and background info on team cars, car drivers, golf players, etc. They integrate rich multimedia and interactive interfaces. Unfortunately, these devices lack with many drawbacks. A first drawback is the fact that the technology is usually implemented using a point-to-point connection, such point-to-point connection does not allow a massive use of the device at a live event as an important frequency bandwidth would be necessary to serve an important number of users. Such devices have a limited effectiveness when delivery video content due to the limited bandwidth used. Moreover, data compression schemes are mandatory in order to cope with limited bandwidth. It is difficult, in these conditions, to have a real time transmission of video data streams. These devices are also very expensive due to the fact that they are based on an expensive hardware architecture.

There is a need for a method and apparatus to overcome the above-mentioned drawbacks.

SUMMARY OF THE INVENTION

It is an object of the invention to provide a method for broadcasting more than one video program and data to a plurality of reception units;

It is another object of the invention to provide an apparatus for broadcasting more than one video program and data to a plurality of reception units using a point-to-multipoint connection;

It is another object of the invention to provide a method for receiving more than one video program and data transmitted using a wireless point-to-multipoint connection;

It is another object of the invention to provide an apparatus for receiving more than one video program and data transmitted using a wireless point-to-multipoint connection;

According to the above objects, from a broad aspect, the present invention provides a method for providing a plurality of video programs to a plurality of video program receivers having a first resolution using a single frequency band enabling transmission of a video program having a second resolution substantially higher than the first resolution, the method comprising the steps of receiving a plurality of video programs from a plurality of video program sources, the plurality of video programs having a resolution substantially equal to the second resolution; formatting each of the plurality of video programs received from the plurality of video program sources to have a resolution substantially equal to the first resolution; inserting each of the formatted video programs at a specific location in a main video signal having a resolution substantially equal to the second resolution and transmitting the main video signal to each of the plurality of video program receivers.

According to another broad aspect of the invention, there is provided an apparatus for broadcasting at least one of a plurality of video program signals inserted in a main video signal to a plurality of receiving units, each receiving unit having a first resolution, the main signal having a second resolution substantially higher than the first resolution, the apparatus comprising a formatting unit receiving the at least one of a plurality of video programs signals, the formatting unit formatting the at least one of a plurality of video program signals to have a resolution substantially equal to a resolution of a receiving unit, the resolution of the receiving unit being substantially lower than the resolution of the main video signal, a combining unit, receiving the formatted at least one of a plurality of video signals and incorporating each of the formatted at least one of a plurality of video signals into a specific location in the main video signal and a transmitter, receiving the main video signal and transmitting the main video signal to the plurality of receiving units.

According to another broad aspect of the invention, there is provided an apparatus for displaying at least one of a plurality of video program signals inserted in a main video signal, the at least one of a plurality of video program signals having a first resolution, the main signal having a second resolution substantially higher than the first resolution, the apparatus comprising a receiving unit receiving the main video signal, a user interface for enabling a user to select at least one of the plurality of video programs contained in said main video signal for a display, the user interface providing a command signal representative of the selected at least one of the plurality of video programs to display, a display screen, receiving the selected video signal for display and a processing unit receiving the main video signal and selecting at least one part of the main video signal provided by the receiving unit according to said command signal provided by the user interface, the selected one of the plurality of video programs to display being displayed on said display screen.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features, aspects and advantages of the present invention will become more clearly understood with the following description and accompanying drawings, wherein:

FIG. 1 is a diagram that shows a transmitting unit and a plurality of reception units;

FIG. 2 is a diagram that shows a perspective view of a reception unit; the reception unit comprises a plurality of buttons for enabling a user to control it;

FIG. 3 is a diagram that shows one image of a main video signal; the image comprises four different images originating from different video signals;

FIG. 4 is diagram which shows how four sound track signals are embodied in a single main video signal;

FIG. 5 is a flow chart that shows how various video program signals are transmitted to a plurality of reception unit;

FIG. 6 shows a block diagram of the preferred embodiments of a reception unit, the reception unit comprises a tunable receiver, a video digitizer, a Field Programmable Gate Array (FPGA), a frame buffer, a graphics storage unit, a microprocessor, a user interface, an audio unit, a display unit and an input/output interface;

FIG. 7 is a flow chart that shows how the reception unit operates in the preferred embodiment of the invention;

DETAILED DESCRIPTION OF DIFFERENT EMBODIMENTS

Now referring to FIG. 1, there is shown the preferred embodiment of the invention. The system comprises a broadcasting unit 17, a plurality of sound sources, a plurality of video sources, a data source 24, and a plurality of reception unit 28.

The broadcasting unit 17 comprises a sound formatting unit 18, a video formatting unit 20, a combining unit 22, a transmitting unit 26.

The sound formatting unit 18 receives a plurality of sound track signals from the plurality of sound sources. The sound formatting unit 18 provides a plurality of formatted soundtrack signals. In the preferred embodiment of the invention, the formatted soundtrack signals have a specific bandwidth as explained below.

The video formatting unit 20 receives a plurality of video signals from a plurality of video sources. The video formatting unit 20 provides a plurality of formatted video signals. In the preferred embodiment of the invention, the formatted video signals have a pixel resolution of 360 by 240.

The combining unit 22 receives the plurality of formatted soundtrack signals, the plurality of formatted video signals, and a data signal provided by the data source 24. The combining unit 22 combines the plurality of formatted soundtrack signals, the plurality of formatted video signals, and the data signals into a single video signal. In the preferred embodiment of the invention, the combined video signal is a NTSC compatible video signal. Still in the preferred embodiment of the invention, four sound sources 10 are used, and four video sources are used in order to combine the video signals. In another embodiment of the invention, more than one video sources and more than one sound sources may be used. The transmitting unit 26 receives the combined video signal and transmits the combined video signal in the preferred embodiment of the invention. The transmitting unit 26 operates under the North American NTSC broadcast standard, which includes the luminance carrier, the chrominance carrier, and the audio carrier. The total bandwidth of the transmitted signal does not exceed 6 MHz. Still in the preferred embodiment of the invention, the transmitting unit 26 is capable of covering a range of 3 km, which is necessary to suit the needs of the application. In the case of an event requiring more a larger coverage, a more powerful transmitting unit 26 may be used.

A plurality of reception units 28 receive a transmitted signal transmitted using the transmitting unit 26. As explained below, each of the reception units 28 are able to receive at least one of the plurality of video sources and at least one of the corresponding sound sources.

Now referring to FIG. 2, there is shown a reception unit 28. The reception unit 28 comprises a display screen, which is a LCD display screen 96. Still in the preferred embodiment of the invention, the display screen 96 is visible in the light and at night using front light TFT active matrix technology. The display measures 3.8 inches in diagonal. The display screen 96 has a pixel resolution of 320 by 240. The aspect ratio of the display screen is the North American TV standard 4:3. It will be appreciated by someone skilled in the art that other television standards may be used.

The reception unit 28 comprises a user interface having a plurality of buttons. In the preferred embodiment of the invention, the user interface comprises a power on/off button 30, a back button 32, a graphics menu 34, a volume up button 36, a volume down button 38, a left button 40, a right button 42, an up button 46, a down button 44 and a enter button 48.

The power on button 30 enables the user to switch on, switch off the reception unit 28. The volume up button 36 enables the user to increase the output volume of the reception unit 28. The volume down button 38 enables the user to decrease the output volume of the reception unit 28. The menu button 34 enables the user to access graphics. The back button 32 enables the user to access a screen display prior a last command. The left button 40, the right button 42, the down button 38, and the up button 46 enable the user to navigate in a plurality of menus displayed on the display screen 96. The enter button 48 enables the user to confirm a selection in a menu displayed on the display screen of the reception unit 28.

Now referring to FIG. 3, there is shown a diagram which presents a single image of the combined video signal generated by the combining unit 22. The single image shown in this figure comprises four sub-images, respectively sub-image 80, sub-image 82, sub-image 84 and sub-image 86. Sub-image 80 refers to an image originating from the first video source. Sub-image 82 refers to an image originating from the second video source. Sub-image 84 refers to an image originating from the third video source. Sub-image 86 refers to an image originating from the fourth video source.

In the preferred embodiment of the invention, the pixel resolution of the sub-image 80, the sub-image 82, the sub-image 84 and the sub-image 86 is 320 by 240.

Now referring to FIG. 4, there is shown how audio is formatted in the preferred embodiment of the invention.

In the preferred embodiment of the invention, the first sound track signal is stored in the main audio channel portion of the combined video signal, which is referred as the L+R portion of the combined video signal. Still in the preferred embodiment of the invention, the second sound track signal is stored in the L−R portion of the combined video signal; the third sound track signal is stored in the SAP portion of the combined video signal and the fourth sound track signal is stored in the cue channel portion of the combined video signal. It will be appreciated by someone skilled in the art that alternatives storing schemes may be used depending on the transmission standard used. Furthermore, it will be appreciated that the first sound track signal, the second sound track signal, the third sound track signal and the fourth sound track signal may be compressed using a CODEC prior being inserted in the combined video signal. Someone skilled in the art will appreciate that compression may provide a higher sound quality.

Now referring to FIG. 5, there is shown a flow chart which shows the operating of the broadcasting unit 17. According to step 50, a first video signal is provided by a video source. According to step 52, a first soundtrack signal is provided by a first sound source. According to step 54, a second video signal is provided by a second video source. According to step 56, a second soundtrack signal is provided by a second sound source. According to step 58, a third video signal is provided by a third video source. According to step 60, a third soundtrack signal is provided by a third sound source. According to step 62, a fourth video signal is provided by a fourth video source. According to step 64, a fourth soundtrack signal is provided by a fourth sound source. According to step 66, the first video signal provided in step 50, the second video signal provided in step 54, the third video signal provided in step 58 and the fourth video signal provided in step 62 are formatted in a suitable format by the video formatting unit 20 as explained below. According to step 68, the first soundtrack signal provided in step 52, the second soundtrack signal provided in step 56, the third soundtrack signal provided in step 60, and the fourth soundtrack signal provided in step 64 are formatted by the sound formatting unit 18 into a suitable format as explained below. According to step 70 the combining is performed using the plurality of formatted soundtrack signal generated according to step 68 and the plurality of formatted radio signals generated according to step 66 and using a data signal providing according to step 48. According to step 72, the combined signal generated to step 70 is transmitted using the transmitting unit 26.

In an alternative embodiment of the invention, at least one graphics source may be used instead of at least one video source.

Now referring to FIG. 6, there is shown a block diagram of the reception unit 28 in the preferred embodiment of the invention. In the preferred embodiment of the invention, the reception unit 28 comprises a tunable receiver 80, a video digitizer 82, a Field Programmable Gate Array (FPGA) 84, a frame buffer 86, a graphics storage unit 88, a microprocessor 90, an audio unit 92, a display unit 102, a user interface 98, and an input/output interface 100. The display unit 102 comprises a LCD driving circuit 94 and a LCD screen 96.

In the preferred embodiment of the invention, the LCD screen 96 is a Sanyo TM038QV-67A02A; the FPGA 84 is a Xilinx Spartan II. Still in the preferred embodiment of the invention, the microprocessor 90 is a Microchip PIC16F877. The tunable receiver 80 is a Samsung TCPN9081DA10C. The video digitizer 82 is a Philipps SAA7111. The frame buffer 86 is a ISSI IS62LV12816L. The graphics storage unit 88 is an AMD 29LV640D.

The combined video signal transmitted using the transmitting unit 26 is received by an antenna of the tunable receiver 80. The microprocessor 90 sends a selected channel signal to the tunable receiver 80. The tunable receiver 80 extracts a video signal according to the selected channel signal. The video digitizer 82 digitizes the video signal received from the tunable receiver 80. The FPGA 84 receives the digitized video signal provided by the video digitizer 82 and stores at least one frame of the digitized video signal into the frame buffer 86; the digitized video signal is stored into the frame buffer 86 at a rate of 30 frames per second in the preferred embodiment of the invention. The FPGA 84 further extracts the embedded data comprised in the Vertical Blanking Interval (VBI) portion of the digitized video signal and stores the data in the FPGA 84.

The microprocessor 90 controls the audio unit 92. In the preferred embodiment of the invention, the audio unit 92 comprises an audio amplifier receiving an audio signal received from the tunable receiver 80 according to a selected portion of the video signal transmitted in accordance with the storing scheme presented in FIG. 4. The user may provide information using the user interface 98 to the microprocessor 90. An input/output interface 100 is connected to said microprocessor 90 in order to upload/download information from a remote device. Information downloaded from a remote device may comprise graphics data which, after being collected by said microprocessor 90 via said input/output interface 100, are provided to the graphics storage unit 88 via the FPGA 84. The FPGA 84 provides a video signal to display to the LCD driving circuit 94 of the display unit 102. The LCD driving circuit 94 provides a final signal to the LCD screen 96.

Now referring to FIG. 7, there is shown the operation of the reception unit 28. According to step 110, a configuration set up is performed. The configuration set up 110 comprises the providing of a selected channel signal to the tunable receiver 80. In the preferred embodiment of the invention, the reception unit 28 receives simultaneously a single channel signal, in an alternative embodiment, the reception unit 28 may receive, simultaneously, a plurality of channel signals using a plurality of tunable receivers 80. Still according to the configuration set up, the display unit 102 is carefully tuned by the microprocessor 90 via the FPGA 84. According to step 112, the user performs a mode selection. If the user selects the video mode, a first channel is selected according to step 114. According to step 116, video is processed by the FPGA 84. More precisely, the FPGA 84 retrieves a frame from the frame buffer 86. The FPGA 84 descrambles the retrieved frame and provides the video signal to display to the LCD driving circuit 94. The tunable receiver 80 extracts a corresponding audio signal to the video signal selected from the corresponding portion of the transmitted video signal. The audio unit 92 provides an amplified audio signal, which may be listened by the user using headsets for instance. The amplified audio signal and the displayed video signal are provided to the user according to step 118.

If the user selects the graphics mode using the menu button 34, according to step 120, a menu is provided to the user. The menu is created using data extracted from the digitized video signal in the Vertical Blanking Interface (VBI) portion of the signal and stored in the FPGA 84 and/or using graphics data stored in the graphics storage unit 88. In the preferred embodiment, graphics are stored using BMP file format.

The microprocessor 90 controls the FPGA 84 to generate a video signal to be displayed which is then provided to the LCD driving circuit 94, the video signal to be displayed comprises the above-mentioned data provided by the FPGA 84 together combined with graphics data stored in the graphics storage unit. According to step 122, the user selects via the user interface 98 a new data to obtain. In one application of the invention, the data may be the ranking of a participant of the live event, a summary of a part of the event. According to step 124, the microprocessor 90 controls the FPGA 84 to retrieve data, which is stored in the FPGA 84. According to step 126, the data are provided to the user as explained previously. In the preferred embodiment of the invention, the video signal to be displayed comprises the data as well as graphics data retrieved from the graphics storage unit 88 by the FPGA 84. The video signal to be displayed is therefore created by the FPGA 84.

Now referring back to FIG. 1, the sound formatting unit 18 converts the first soundtrack signal, the second soundtrack signal, the third soundtrack signal and the fourth soundtrack signal into formatted soundtrack signals that will be combined and modulated to create a combined video signal having the first soundtrack signal, the second soundtrack signal, the third soundtrack signal and the fourth soundtrack signal modulated according to the scheme displayed in FIG. 4. Still referring to FIG. 1, the video formatting unit 20 comprises four digitizers receiving respectively the first video signal, the second video signal, the third video signal and the fourth video signal and providing a first digitized video signal, a second digitized video signal, a third digitized video signal and a fourth digitized video signal. The video formatting unit 20 further comprises four interpolating units respectively connected to the first digitizer, the second digitizer, the third digitizer and the fourth digitizer. The first interpolating unit receives the first digitized video signal, the second interpolating unit receives the second digitized video signal, the third interpolating unit receives the third digitized video signal and the fourth interpolating unit receives the fourth digitized video signal. Each interpolating unit dismisses one pixel about two horizontally and one pixel about two vertically. The first interpolating unit provides therefore an interpolated image that has a pixel resolution of one about four of the original pixel resolution, the resolution of the first digitized image provided to the first interpolating unit. The second interpolating unit, the third interpolating and the fourth interpolating unit operate in the same manner as the first interpolating unit. The combining unit 22 receives the formatted video signals and the formatted soundtrack signals and provides a combined video signal.

In order to protect the network against eavesdropping and uncontrolled use, the combining unit 22 further comprises a scrambling unit which scrambles the combined video signal prior providing it to the transmitting unit 26; this scrambling unit is not shown in FIG. 1.

In the preferred embodiment of the invention, switching vertical lines two by two performs the scrambling. The FPGA comprised in the reception unit is used to descramble the transmitted video signal. Someone skilled in the art will appreciate that other scrambling schemes may be used. A code related to said scrambling is stored in a code storing unit connected to said FPGA.

Alternatively, a single sound track is provided by a single sound source to the sound formatting unit 18, and a single video signal is provided by a single video signal to the video formatting unit 20. In such embodiment, the transmitted video signal comprises the single sound track signal and the single video signal. However, in such embodiment, an encoding is performed prior the transmitting in order to avoid unauthorized reception of the transmitted signal. The signal may be transmitted using in analog or digital techniques. It will be appreciated that such alternative embodiment is particularly well-suited for an event requiring a short geographic scale coverage. 

1. A method for providing a plurality of video programs to a plurality of portable video program receivers at a venue hosting a live event, comprising: receiving a plurality of video streams derived from video cameras capturing images of the live event; reducing image resolution of the plurality of video streams to produce multiple resolution reduced video streams; accessing data content that includes menu data and computer generated graphics related to the live event, the menu data for use by the portable program receivers to create and display a menu, the menu includes a list of options to make selections, one or more of the options is to access and display the computer generated graphics related to the live event, the computer generated graphics are not video data captured from a video camera, the data content is independent of the video streams; combining the multiple resolution reduced video streams and data content into a combined signal that includes the multiple resolution reduced video streams, the menu data and the computer generated graphics combined such that the plurality of portable video program receivers can extract one of the video streams and the plurality of portable video program receivers can extract the data content; and generating a wireless RF signal to wirelessly convey the combined signal to the plurality of portable video program receivers.
 2. A method as defined in claim 1, including receiving a plurality of sound tracks associated with respective video streams and wirelessly conveying audio information derived from the sound tracks to the plurality of portable video program receivers.
 3. A method as defined in claim 2, including receiving a data signal from a data source, the data content is derived from the data signal.
 4. A method as defined in claim 3, wherein the live event is a sporting event, the data content conveying information about ranking of a participant in the live event.
 5. A method as defined in claim 4, wherein the live event is a motor sports event.
 6. A method as defined in claim 1, wherein each video stream has an image resolution of 720 pixels by 480 pixels before said reducing.
 7. A method as defined in claim 6, wherein each resolution reduced video stream has a resolution of 360 pixels by 240 pixels.
 8. A method as defined in claim 3, wherein the wireless RF signal is digital.
 9. A method as defined in claim 8, wherein the wireless RF signal is contained within a single frequency band.
 10. A method as defined in claim 9, wherein the single frequency band has a bandwidth of about 6 MHz.
 11. An apparatus for broadcasting multiple video programs to a plurality of portable video program receivers at a venue hosting a live event, said apparatus comprising: a first input interface that receives a plurality of video streams derived from video cameras capturing images of the live event; a second input interface that receives a data signal from a data source, the data signal includes menu data and computer generated graphics related to the live event, the menu data for use by the portable program receivers to create and display a menu, the menu includes a list of options to make selections, the computer generated graphics are not video data captured from a video camera, the data content is independent of the video streams; and a transmitter that generates and transmits a wireless RF signal to the plurality of portable video program receivers, the wireless RF signal includes the plurality of video streams, the menu data and the computer generated graphics in a common wireless RF signal such that the plurality of portable video program receivers can extract one of the video streams to display and the plurality of portable video program receivers can extract the menu data to create a menu based on the menu data.
 12. An apparatus as defined in claim 11, wherein the wireless RF signal is digital.
 13. An apparatus as defined in claim 12, wherein the wireless RF signal is contained within a single frequency band.
 14. An apparatus as defined in claim 13, wherein the single frequency band has a bandwidth of about 6 MHz.
 15. A method as recited in claim 1, further comprising: receiving the wireless RF signal at a portable video program receiver of the plurality of portable video program receivers; automatically identifying the data content in the RF signal; and storing the data content in a buffer to be used when in a graphics mode of the portable video program receiver.
 16. A method for providing a plurality of video programs to a plurality of portable video program receivers at a venue hosting a live event, comprising: receiving a plurality of video streams derived from video cameras capturing images of the live event; reducing image resolution of the plurality of video streams to produce multiple resolution reduced video streams; accessing data content that includes menu data, the menu data for use by the portable video program receivers to create a menu, the menu includes a list of options that can be selected on the portable video program receivers; combining the multiple resolution reduced video streams and data content into a combined signal that includes the multiple resolution reduced video streams and the menu data combined such that the plurality of portable video program receivers can extract one of the multiple resolution reduced video streams and the plurality of portable video program receivers can extract the menu data; and generating a wireless RF signal to wirelessly convey the combined signal to the plurality of portable video program receivers using a point-to-multipoint transmission.
 17. A method as defined in claim 16, wherein the wireless RF signal is contained within a single frequency band.
 18. A method for providing a plurality of video programs of a live event, comprising: receiving a wireless signal at a portable receiver, the wireless signal comprises a plurality of video streams from video cameras capturing images of the live event combined with data content, the data content includes menu data, the menu data provides for the portable receivers to display a menu, the menu includes a list of options for selection; receiving a selection of one of the video streams; extracting the selected video stream from the combined video streams and data content; displaying the selected video stream on the portable receiver; extracting the data content from the combined video streams and data content; creating a menu on the portable receiver using the data content extracted from the combined video streams and data content; receiving a selection in the menu to access data; retrieving the data in response to the selection; and providing the retrieved data to the user.
 19. The method as defined in claim 18, wherein the wireless signal is received at a single frequency band.
 20. The method as defined in claim 18, wherein: the data content includes computer generated graphics related to the live event; and the menu includes a list of options to make selections, one or more of the options is to access and display the computer generated graphics related to the live event, the computer generated graphics are not video data captured from a video camera, the data content is independent of the video streams.
 21. A portable video program receiver for use at a event, comprising: a receiver for wirelessly receiving a plurality of video streams from video cameras capturing images of the event and data content in a combined wireless signal, the data content includes menu data; a display; data storage; and a processing system in communication with the display, the data storage and the receiver; the processing system receives a selection of one of the video streams, extracts the selected video stream from the combined wireless signal, causes the selected video stream to be displayed, extracts the data content from the combined wireless signal, creates a menu on the display using the data content extracted from the combined wireless signal, receives a selection in the menu to access data, retrieves the data in response to the selection and provides the retrieved data to the user.
 22. The portable video program receiver as defined in claim 21, wherein: the processing system comprises a microprocessor and a FPGA. 